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We discuss the physical meaning and significance of statistical forces on quasi-static probes 
in first order around detailed balance for driven media. Exploiting the quasi-static energetics 
and the structure of (McLennan) steady nonequilibrium ensembles, we find that the statisti¬ 
cal force obtains a nonequilibrium correction deriving from the excess work of driving forces 
on the medium in its relaxation after probe displacement. This reformulates, within a more 
general context, the recent result by N. Nakagawa (Phys. Rev. E 90, 022108 (2014)) on ther¬ 
modynamic aspects of weakly nonequilibrium adiabatic pumping. It also proposes a possible 
operational tool for accessing some excess quantities in steady state thermodynamics. Eur- 
thermore, we show that the point attractors of a (macroscopic) probe coupled to a weakly 
driven medium realize the predictions of the minimum entropy production principle. Finally, 
we suggest a method to measure the relative dynamical activity through different transition 
channels, via the measurement of the statistical force induced by a suitable driving. 

Statistical forces are responsible in thermodynamics for generating transport of energy, momen- 
tnm or matter as a result of the irreversible tendency to approach eqnilibrium [T]. They can be 
realized as trne mechanical forces by conpling a probe to the macroscopic medium. The probe can 
itself be a macroscopic device like a wall or a piston with pressure as the statistical force. Another 
example are elastic forces which can be thought of as entropic forces when all interactions are ig¬ 
nored, working simply by the power of large numbers [2]. For our set-up (Fig{^a)) we have in mind 
a dilute suspension of colloids (= probe particles) in a fluid (= medium) with mutual coupling, i.e., 
both colloid and fluid react to each other as dictated from an interaction potential. We assume 
however that the colloid is quasi-static, meaning that its characteristic time is much longer than 
that of the fluid. The resulting effective dynamics of the colloid picks up various aspects of the 
fluid; there are the friction and the noise as usnal for motion in a thermal bath, but because of 
our assumption of infinite time-scale separation we concentrate here exclusively on the systematic 
force which is the statistical average over the fluid degrees of freedom of the mechanical force on 
the colloid; see [ 311 ! for further discussion on friction and noise in nonequilibrium media. The 
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general question concerning thermodynamics of active or driven media is of much current interest, 
e.g. for exploring the validity of equations of state in nonequilibrium [SHH]. 

For a probe in contact with an equilibrium reservoir the free energy is a potential for statistical 
forces. The present paper studies these forces for reservoirs that are subject to weak driving. By 
the latter we mean that the fluid particles are undergoing rotational (nonconservative) forces with 
dissipation in yet another background environment that will just be represented by its temperature; 
see Figj^a). The main question is to see how that nonequilibrium feature corrects the gradient 
statistical force derived from the (equilibrium) free energy. Or, vice versa, how the force on the 
colloid teaches us about irreversible thermodynamic features of the fluid. The result is that to 
linear order in the amplitude of the rotational forces the work on the probe equals the excess 
work done on the fluid by the rotational forces in its relaxation to the new stationary condition 
corresponding to the slightly displaced probe. A similar result was already obtained in [9j in the 
context of cyclic adiabatic pumping. 

Excess quantities are omnipresent in discussions on steady state thermodynamics. Their origin 
is theoretical, trying to distinguish steady state effects from transient effects also for nonequilib¬ 
rium fluids. Indeed when driven, the fluid obtains a stationary dissipation with some mean entropy 
production rate in the environment. However, as some external parameters change in time, re- 
laxational processes of the nonequilibrium fluid will also contribute to (excess) dissipation. The 
origin of such decomposition, housekeeping versus excess dissipation, is probably found in the work 
of Glansdorff and Prigogine mm, but it has since been repeatedly stressed also in more recent 
studies of steady state thermodynamics dMS]. For example, for thermal properties of nonequilib¬ 
rium systems one introduces the excess heat which defines nonequilibrium heat capacities dziiis]. 
One recurrent difficulty however is to find a good operational meaning of these excess quantities. 
Nature does not dissipate the steady heat and the excess heat separately; similar for the notion 
of excess work. That is why it can be useful to find that the statistical force on a probe is di¬ 
rectly related to excess work, at least close to equilibrium and for thermodynamic transformations 
controlled by mechanical motion of a probe. 

A further motivation of the present work is to complete the close-to-equilibrium theory of steady 
state thermodynamics with the nature of statistical forces. Clearly and as we will see in Section 
|I] statistical forces enter in the First Law for the energy balance. They are therefore very much 
part of the theory of irreversible thermodynamics for composed systems (here, probe plus fluid). 
Moreover, as is the content of Section |IV[ the question appears in what sense these statistical 
forces realize the minimum entropy production principle; see [19]. In other words, whether we can 
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understand statistical forces as the way in which systems achieve minimum entropy production 
rate. The answer is positive in the sense that indeed the very requirement of minimal entropy 
production rate for the composed system again and also determines the statistical force in terms 
of the excess work. 

A third direction in which statistical forces are interesting, is that they are able to make visible 
aspects of (time-symmetric) dynamical activity. That is not surprising because excess work involves 
the dynamics and hence, in contrast with the free energy which is static, kinetic factors will be 
present in the statistical force. We build that into a “frenometer” to get explicit information about 
the relative dynamical activity through reactivity channels; see Section |V} 

We begin the paper with a thermodynamic approach based on specifying the energy balance 
close-to-equilibrium. We find the relation between excess work of the medium, the force done 
on the probe and the nonequilibrium heat capacity. Section |TI] gives the corresponding statistical 
mechanical basis. We need the McLennan ensemble theory to determine the correction to the 
equilibrium statistical forces. It gives a second derivation of the result that relates excess work of 
the medium with the work to displace the probe. We end Section |TI] with a discussion about the 
validity of our result when kinematical time reversal is included (like for underdamped diffusions). 


Section III is devoted to a detailed illustration of the framework in context of a linear system. 
The relation between excess work and statistical forces is rederived using the minimum entropy 


production principle in Section IV The relation between statistical work and relative dynamical 
activity is contained in Section |Vj suggesting as we already mentioned, a simple “frenometer”. 
The present work follows and substantially extends [20) where the main idea has been reported. 


I. ENERGETICS OE IRREVERSIBLE THERMODYNAMICS 

We refer to Fig. [^a) for a cartoon of three classes of particles. There is the probe on which 
a force is induced by its contact with a medium and a heat bath. The medium is subject to 
nonequilibrium conditions and dissipates into the (equilibrium) heat bath at temperature T. In 
general x denotes the “position” (possibly multi-dimensional) of the probe. With / the statistical 
force, the corresponding work performed by moving the probe is / • dx. The stationary energy of 
the medium when the probe is at x is denoted by E{x). Then, the quasi-static energetics (or “First 
law”) of the nonequilibrium medium is generally given by the balance equation for the energy as 


dFi(x) = —/ • dx -|- dVF®^(x) -|- dQ®^(x) 


(1) 




4 


where denotes the excess thermodynamic work of the driving forces in the medium along the 

relaxation process that corresponds to the thermodynamic transformation x —?• x+dx, T ^ T +dT, 
and similarly is the (incoming) excess heat. Note that we speak about excesses because 

the stationary medium constantly dissipates work into heat; excess is the extra corresponding to 
the transient process of reaching a new stationary condition. We assume that the excess heat 
satisfies a Clausius relation dQ®^ = TdS'(x) with T the temperature and S{x) can then be called 
the calorimetric entropy. We do not need its detailed expression here. The assumption can be 
checked (as we do in the next Section 0 in the linear regime around thermodynamic equilibrium; 
the original proof is found in the work of Komatsu et al. [El EH- We define the free energy 
F{x) = E{x) — TS{x) for which then, c/. also [15], 

dF = -SdT - f -dx + dW^^ (2) 

By the (equilibrium) minimum free energy principle we know that there is no linear order correction 
in F or dT", meaning that in the considered linear regime F{x) coincides with the equilibrium free 
energy Teq(a^) = T'eq(x) — TS'eq where the First Law for equilibrium combined with the Clausius 
equality is dKeq(x) = —/eq • dx + TdSeq. Expanding around equilibrium, / = /eq + g, S = 
5eq + s, the first-order contributions yield zero free energy change and hence, within the first-order 
approximation. 


dW®^~sdr + 5-dx (3) 

In particular for isothermal processes (dT = 0), we find 

5 • dx ~ dlF®^ (4) 

for the nonequilibrium (to first order around equilibrium) component of statistical force in terms 
of the excess work, whereas for dx = 0 the excess work is related to the nonequilibrium entropy 
correction s, which is itself related to the nonequilibrium heat capacity [nmn. 

Our observation on the absence of the first-order correction in the free energy provides a simple 
variation of formula (13) in [^ by Nakagawa for the work transfer during cyclic adiabatic pumping 
in terms of nonequilibrium (excess) heat into the driven system. However, we do not restrict 
ourselves to any specific protocol of operation. Formula Q gives a direct relation between the 
mechanical force on the probe on the slow time scale and the steady-state thermodynamic process 
in the medium on the fast time scale. Remark that the excess quantities, though omnipresent in 
steady state thermodynamics, c/. the balance equation are known to be not easily accessible 
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directly. Hence, formula (4) could be used to access some of the excess quantities in a mechanical 
way. 

In the next section we give the statistical mechanical basis for the above general thermodynamic 
arguments. 


II. STATISTICAL MECHANICAL APPROACH 


We closely follow the approach of Komatsu, Nakagawa, Sasa and Tasaki [22]. Yet we start from 
a general set-up which formalizes the idea of statistical force on quasi-static probes. There will 
be no need to introduce or indeed to specify the time-evolution except that we assume in general 
that the medium to which the probe is coupled passes through stationary states of some generic 
(McLennan) form. 

We think of r/ as the collection of degrees of freedom of a driven medium. For the rest of the 
paper we assume these variables are even under kinematic time-reversal, so not containing velocity 
degrees of freedom as for example with underdamped diffusions; the results do not change however 


in the more general case — see Section IIC For simple convenience we take them discrete so 
that we use sums when computing averages etc. The medium particles undergo rotational forces of 
order e and they obtain a stationary regime by dissipating heat into a thermal bath at temperature 
T; we also write /3 = T~^ setting Boltzmann’s constant ks = 1- Each stationary regime of the 
medium depends on the position x of a slow probe. The probe is immersed in the medium and the 
contact is modeled via a joint interaction potential U{x, rj) which by assumption also includes the 
interaction among the medium particles as well as the self-interaction of the probe if present. As 
the medium is supposed to be macroscopic it is relevant to define the statistical force on the probe 
as the average mechanical force, 


fix) = -'^ Pxfn) VxK (x, r]) = -{VxU (x, ri)Y (5) 

V 

where the average is over the steady nonequilibrium stationary distribution px of the r/—medium 
at fixed x. Note that the total system is composed (medium particles plus probe) but we work 
under the hypothesis that the 77 —variables are relaxing much faster. When we apply that to the 
case of an equilibrium medium we find the standard result that the statistical force is given as the 
gradient of the free energy. In statistical mechanical writing that free energy is J-'eq(3:) = —TlogZx 
with Zx the equilibrium partition function corresponding to the 77 —medium when in equilibrium 
with fixed probe position x: the distribution is then given by the Boltzmann-Gibbs factor p^{r]) = 
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exp{-/3?7(x,??)}/Za;. 

To go beyond equilibrium, we need information about px for determining ([^. We work under the 
condition of local detailed balance for the nonequilibrium medium |23H26| which relates the probe- 
medium dynamics with the entropy fluxes into the environment (= a heat bath at temperature T). 
By our assumption the driving forces breaking the global detailed balance provide a contribution 
to the entropy fluxes proportional to some small parameter e. 




FIG. 1: (a) A slow probe (light grey disc) is immersed in a nonequilibrium medium (green arrowed circles), 
in contact with an equilibrium reservoir (small blue circles), (b) Excess work V(x,rj) done by the driving 
forces in relaxing to the stationary condition for a hxed probe postion x starting from medium configuration 
77 . Here Wx denotes the mean instantaneous power of the driving forces. 


Close to equilibrium the medium is well described by the McLennan stationary ensemble 

1 


pfHv) = ^e 


-0(U+V){x,v) 


( 6 ) 


Here V{x,r]) is the excess work of driving forces along the relaxation process started from rj with 
X fixed having zero expectation {V)^ = 0 under the stationary distribution px] see Fig. Bb) and 
(Al) in Appendix [A| for the definition. Note that V is itself of order e. It turns out that 


Px — P^^ + 0{£^), Zx — Zx + 0{e^) 


(7) 


with Zx the equilibrium partition function (at e = 0). Formula ([^ describes the steady linear 
regime around equilibrium. For example, linear response formulae can be derived from it; see [28]. 


Specific examples follow below in Sections III and|V| 
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A. Deriving the energy balance 

The stationary energy E{x) = (U)^ changes as 

d{ur = {dur+Y,dpAv)u{x,q) 

v 

The medium is doing work / • dx on the probe, hence 

{dur = -f-dx ( 8 ) 

mimicking ([^ as the mechanical energy U does not depend on temperature. The excess work when 
the medium relaxes from the stationarity under x to the new stationarity under x + dx reads 

dlT®^(x) = p^i-n) V{x + dx, T]) = (dl/)^ (9) 

where we have used {V)^ = 0. Using that condition again and writing (dU)* = 

(renormalized) First law 0 is verified by defining the excess heat as 

dQ®^(x) = ^dpx(?7) (C/ + U)(x,T/) (10) 

V 

Let us now use the statistical mechanical formulas Q-([^ to work in the linear regime, and use 
Px to replace the stationary distribution in leading order around equilibrium. The Clausius 

equality dQ^^ = TdS{x) + O(e^) with entropy 5'(x) = —YlriP^iP) ^^SPxiv), can be obtained 
directly from the definitions when using the McLennan distribution ([^. The free energy equals 

T{x) = {Ur - TS{x) = -T log Z, + 0{e^) (11) 

and indeed has no linear order correction. That verifies the hypotheses involved in the thermody¬ 
namic derivation of 0. We can however also give a direct derivation inserting Q into ([^, which 
comes next. 

B. Excess work equals the nonequilibrium correction to statistical work 

When the medium undergoes nonequilibrium driving, there is a new stationary nonequilibrium 
density. 


Px{r]) = p7{p) [^ + hx{v)] 


(12) 
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in terms of a density hx (of order e) with respect to the reference equilibrium distribution. The 
equilibrium distribution p^{r]) satisfies the identity 


VxPl^iv) = -Pl^iv) 


—VxU{x,r]) +VxlogZx 


We obtain the statistical force f{x) = TVx log Zx + g{x) by multiplying the above relation with 
Pxiv)/p'^iv) and summing over p. The nonequlibrium correction g{x) is then given in terms of the 


density hx defined in (12) above, 


g{x) = -TY, ^xhxiv) p7{v) = -T {VxhxT^^^ (13) 

V 

Since Ylrj = 0 (from the normalization applied to ([Xl])), for a small dis¬ 

placement dx of the probe the work done is 


g{x) ■dx = -T'^ hx+dx{g) P’^xih) = -T{hx+AxT'''^ (14) 

V 

When interested in hrst order around equilibrium we can as well write 


g{x) ■dx = -T {hx+dxT + 0{e^) 


(15) 


with respect to the stationary distribution of the medium in contact with an external thermal bath 
at temperature T. The McLennan distribution ([^ gives hx{p) = —^V{x,p) + 0{e^) and combining 
that with (10) we recover (j^. 


C. Including kinematical time-reversal 

The result that certain excess quantities as encountered in steady state thermodynamics are 
accessible via mechanical measurements, remains valid in a broader context than considered so 
far. We have in mind the case of medium variables p containing velocity degrees of freedom or, 
more generally, dynamical degrees of freedom that are not even under kinematic time-reversal. 
We indicate here briefly where some changes in the arguments would occur. 


First, the purely thermodynamic argument of Section does not change at all. The entropy 
S used there will however get a slightly more general statistical mechanical appearance than in 
Section IIA We have to use the symmetrized Shannon entropy introduced by Komatsu et alp 
see e.g. m for a recent review. Calling tt the kinematic time-reversal (like flipping the sign of 
all momenta) and assuming that the equilibrium reference is vr—invariant, p^{'np) = p‘^{p), we 
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have the Clausius relation (in first order e around equilibrium) = TdS{x) + O(e^) with en¬ 
tropy S{x) = + Pxi'^v)] ^ogpx{p)- That relation again follows by taking for px{p) 

the McLennan distribution, but the excess work V{x,p) does not appear directly in the statisti¬ 
cal weight. Rather, the nonequilibrium correction to the equilibrium distribution has the more 
general form hx{r]) = —^V{x,7rrj) -|- Despite the modification of the entropy function, 

the formulas (14)- © yield g{x) • dx = {V{x + dx,r/))^ -|- O(e^) without any change. Since 
(y{x + dx,?]))^ = (R(x -|- dx,r/))*’®'^ -|- 0{e^) still equals the excess work dlT®^(x) for the trans¬ 
formation X I—?• X -|- dx, we have checked that our main relation (|^ indeed extends to this more 
general case. 


III. LINEAR MODEL 


As an illustration we consider as medium a cloud of non-interacting particles driven by linear 
rotational forces and diffusively moving in a viscous fluid. The linearity is assumed also for the 
interaction with the probe as well as for a potential force trapping the cloud in a bounded region. 
It allows exact calculations and is a good approximation for weak nonlinearities. 
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FIG. 2: The linear model: (a) A slow probe connected with harmonic springs to the cloud particles which 
in turn are connected to the origin and driven by a rotational force, (b) The statistical force for the 
2-dimensional example with nonequilibrium driving e = 2.5 where A = 5.0 and b = 0.1. 


The cloud consists of many particles from which it will make sense consider statistical average 
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but as we take them independent, it suffices to consider just one of them. That generic particle lives 
in d dimensions with coordinate y = {yi,, ya)', we use here y instead of y for better accordance 
with position degrees of freedom. See Fig. [^a) for a d = 2—representation. 

Let > 0 and B,K >0 he symmetric d x d—matrices. The total potential is 

U{x,y) = ^y ■ Asy +^{x-y)- B{x -y) + ]^x-Kx (16) 

where the second term is the interaction potential Ui{x, y) with the probe at position x at coupling 
strength A > 0; the matrix K stands for the “bare spring constant” of the probe. We also include 
a rotational force on the cloud described by an arbitrary antisymmetric matrix Aa and with e 
characterizing its magnitude. The total force Fx{y) on the medium particle for a given position x 
of the probe is then 


Fx{y) = -eAay -VyU{x,y) 

= -eAay - Asy + XB{x - y) 

= -D{y-Cx) (17) 


with the notation D = A + XB, A = Ag + eAa, and Cx = XD~^Bx is the mechanical equilibrium 
position for the medium particle for a fixed probe position. 

A more specific example in two dimensions takes 


A, = I, A, 



B = 



for | 6 | < 1, K = I 


That describes a cloud of particles attached via a spring to the origin, subject to a rotational force 
of strength e and also harmonically coupled to the probe. In that case 


^ / 1 + A Xb — e\ A /(I + A(1 — 6 ^) + e 6 )xi + (6 + £)x2 

yAft + e l + Ay ^ \y{l + X{1 — b'^) — eb)x 2 + {b — e)xi 

where C = (1 + A)^ — A^6^ + e^. 


(18) 


The cloud dynamics is the overdamped diffusion yt at temperature T with friction 7 , 

IVt = Fx{yt) + \/ 27 T 

with standard d—dimensional white noise 

For X fixed the stationary density solving the Smoluchowski equation 


(19) 


V,. 


^^^^Px{y) - - Vy pxiy) 
7 7 


= 0 , for all y 


( 20 ) 
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is the Gaussian density 


p^{y) =^e-2^G-cG-rG-c.) 


( 21 ) 


where M = [det(r)/(27rT)‘^]^/^ is the normalization and T is the (unique) positive symmetric matrix 
satisfying 


DT-^ +T-^D'< = 21 


( 22 ) 


or, equivalently, the symmetric part of m must equal see Appendix [b 1 In particular, if D is 
normal in the sense that it commutes with its transpose, = D^D, then the solution to (22) 


reads F = Dg = Ag + XB. On the other hand, for non-normal D’s the matrix F does depend on 


e. Observe however also in (21) the temperature-dependence which is always of the Boltzmann- 


Gibbs form, so that the stationary density for the medium can be seen as an equilibrium for 
the oscillator energy with “spring constant” F and equilibrium position Cx- The (nonequilibrium) 
e—dependence sits in Cx and for non-normal D also in F. Note by comparing (12)- © with 


(21), that we already know that the nonequilibrium correction in the statistical force will also be 


temperature-independent. 

Coming back to the above 2-dimensional example we find that D is non-normal whenever 
eb 7 ^ 0. The stationary density is determined there by 


1 I ^ + l-HA 

^ ' Xb 


Xb 


1 + A- 


e(Ab—e) 
1+A 


(23) 


with K = 1 + (ify)^ 

The statistical force on the quasi-static probe follows from VxU{x,y) = XB{x — y) + Kx, and 
equals 


fix) = - J VxU{x,y) pxiy)dy 

= XB {cx -x) - Kx = -{A+ \kB-^D) Cx = -Mx 

A 


(24) 


where M = K + XB — X^BD~^B = K + A(i?“^ -|- AA“^)“^. Of course the contribution of K 
is not statistical and was there as self-potential from the beginning. Note that the statistical 
force is temperature-independent. As for linear overdamped dynamics, rotational forces enter via 
asymmetric matrices and it is indeed useful to decompose M = Mg + Ma with Mg = (M -|- M^^)/2, 
Ma = {M — M1)/2. The antisymmetric component Ma quantihes the induced rotational part and 
is of order eX?. 
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Continuing with the above 2-dimensional example, we have that the antisymmetric part equals 


Ma = 


eA^(l — 6^) 


-4, 


(l + A)2-A262 + e2 

and the symmetric part of M obtains a second-order correction with respect to equilibrium, 


(25) 


A /l A(1 - 62) + £2 
Ms = K + -{ 

^ Y 6(1-I-e2) 1-I-A(1 — 62)-I-e2 

1 /(l + A)(l + 2A + e2)- 262 a2 A6 (l + e2) 

^ y A6(l + e^) (1 + A)(l + 2A + e^) - 2b^X‘^ 

Such a renormalization of the “bare” interaction constant due to coupling with environment is 
often called a “Lamb shift”; here we see how it obtains a nonequilibrium contribution of order 
O(Ae^) from the driving of the medium. In Fig. [^b) we plot the phase portrait of the statistical 
force under a specific choice of parameters. 

The resulting motion of the probe depends of course on still other aspects of the medium and 
bath. There will be friction and noise as further corrections to the statistical force, but for a 
quasi-static and macroscopic probe of mass m we simply put 



mx = f{x) (here = —Mx) 


for its equation of motion. 


To obtain yet another representation of the statistical force we observe (see Appendix]^ that 


for (16), 


u {x, y) = ^{y- Cx) ■ Ds{y- c^) + ■ Da{y - Cx) + ]^x ■ MsX 


(with Da = sAa) and the mean energy is 


{Uf = ^T+'^x-MsX 


(27) 


Combined with the medium’s stationary entropy 


s{x)^-{iogp,r = ‘D\iog^^ 


we obtain the nonequilibrium free energy 


J-(x) = {Uf - TS{x) = 2 log + \x-Ms X 


(28) 
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The latter is to be compared with its equilibrium counterpart 

T-eq(x) = -T log I dy 

1 det(Zl.) 1 ( 0 ) 

2 ^ {27rT)d ^ 2 ^ 

with = K + A[i3 — XBD~^B]. Note that from the Gibbs variational principle, B{x) > Beq{x)] 
their difference comes from Mg = + O(e^A). 


As a consequence the statistical force (24) is manifestly a sum of two contributions, 


fix) = -V^Fix) -MaX = -Max 


(29) 


The rotational force —AaV on the medium has been transformed into (i) a shift in the free energy 
which (still) determines the conservative component of the force, and (ii) an induced rotational 
force —MaX. The total nonequilibrium correction to the statistical force on the probe is then given 
by 

g{x) =-{Mg- Mio))x - MaX (30) 


According to the general theory the term — x corresponds to the excess work of the rotational 
forces on the medium, at least close to equilibrium as we have argued in the previous Sections. 
We now check that within the present linear framework that is in fact exactly (to all orders of e) 
verified (but the McLennan distribution ([^ is not exactly equal to ([^). 

We need to calculate the excess work V(x, y), first when starting the medium from fixed position 
y at fixed probe position x. We follow the derivation in the first part of Appendix [A| The expected 
power of the total force F^iy) on the medium particle is equal to 


1 T 

Wx{y) = -Fx{y) ■ Fxiy) + -Vy • F^iy) 

7 7 


(31) 


(see for example equation (III.5) in [55] or Appendix]^. Then, following (Al), 


Uix,y) - (U)^+ V{x,y) = [{wxiyt)\yo = y)'" - (wx)''] dt (32) 

Jo 

After some computation (see Appendix 0 we find the excess work due to the rotational force, 
starting from a fixed medium particle position y given by 


^y) = ^(y-cx)-^(y-cx)-jTr (nr ^) -u (x, y) + (u)^ 


(33) 


where is a positive symmetric matrix such that 


(D-^)'^n + nD-^ = 21 


(34) 





(When D is a normal matrix, then Q ^ = (D and fl = F — F 

The averaged excess work (10), when the probe is shifted from x —)• x + dx is 
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dVF®'^(x) = y dy Px{y) [1^ {x + dx, y)-V (x, y)] 


We have, from (33), to linear order in dx. 


dVF®^(x) = V^{U)^-dx-iV^Uf-dx 
= MgX ■ dx — Mx ■ dx 

= —MaX ■ dx 


(35) 


Thns the excess work dissipated by the medium due to the rotational force is equal to the work 
done on the probe by the rotational component of the statistical force when the probe position is 
shifted by an amount dx. 


For the two-dimensional example we find 


n = 


Xb 


Xh 


1 + A- 


£{\h—e) 

1+X 


and by comparing with (23) we check the relation = kF (moreover, Fll = D^D) which means that 
the stationary distribution of the cloud is given by an exact variant of the McLennan ensemble 
Px{y) oc exp [—(17 -|- 17)(x, y)/Teff], with the modified potential U + V and the “renormalized” 
temperature = kT = T + 0{e^). As a consequence the two-dimensional model satisfies the 
exact generalized Clausius relation = TggdS (with respect to all possible thermodynamic 

transformations) where S{x) = —{logpx)^ is the stationary (Shannon) entropy. 


IV. REALIZING MINIMUM ENTROPY PRODUCTION 

In that same linear regime, statistical forces should reflect the tendency of the compound system 
(probe plus nonequilibrium medium) to reach the condition of minimum entropy production rate 
(MINEP), |19j . valid for close-to-equilibrium media with degrees of freedom that are even under 
kinematic time-reversal. We show now that the opposite also holds giving a third proof of (Q: 
requiring MINEP implies that the work needed to move the probe over dx equals the change in 
equilibrium free energy plus excess work done by the nonconservative forces on the medium to 
relax from the old stationary condition px to the new one described by Px+dx- 
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A. Minimal nonequilibrium free energy 


Before we go to the actual application it is useful to derive an alternative (but equivalent) 
formulation of the minimum entropy production principle in terms of a nonequilibrium free energy 
functional. 

Suppose we have states a (they will be the states a = (x, r/) of our compound system) and 
probability distributions /r on them. There is a driven process at that satisfies the condition of 
local detailed balance. There is a unique stationary distribution p and obviously there is a trivial 
variational principle s{p, \ p) > 0 with equality only if /r = pm. terms of the relative entropy 
■ 5 ( 1 * I P) — Pi^)] simplicity we take here finite irreducible Markov processes). 

That variational formula starts being useful if log/9((T) has a (thermo)dynamical meaning. That 
is certainly the case at equilibrium but also near equilibrium where p = + O(e^) in ([^ is 

expressed in terms of energy and excess work. If we find p that minimizes 

p{a) log p{a) + p'Y^p{a){U + V){a) +\ogZ >0 (36) 


then (obviously) p = p^^ and p = p + 0{e^) is a perfect linear order approximation to the true 
stationary distribution. In the expression ( |36[ ) we recognize the time-integrated entropy production 
for the process relaxing from p versus from the McLennan distribution. That is because there 
logZ = + V){a) f?^^{a) + S(p^^). In that sense we do exactly what the minimum 

entropy production is doing, and in fact by requiring d/df s{pt \ p^^)t=o < 0 we would even recover 
it in its usual instanteneous version, m- 


Let us still rewrite (36) using the variational nonequilibrium free energy functional 


T-„eq(/i) = Y.{U + V){a) p{a) -TS{p) 

a 


(37) 


At stationarity p = 
T S{p), since {V) = 
variational principle 


p it coincides with the usual free energy functional Tneq(p) = ^[p) = {U) — 


0, and Tneq(p^^) = —TlogZ. Furthermore, the positivity in (36) gives the 


.Tneq(p) > Jneq(p^^) (38) 

with equality for p = = p -|- O(e^). That is the free energy version of MINEP: correct to first 

order e the stationary distribution is the one that has lowest (nonequilibrium) free energy. Note 
also that F{p) = —T logZ + O(e^), and p{cr)V {a) = O(e^) whenever p/p = 1 -|- 0(e). To 
the best of our knowledge that formulation is new and especially useful for work-considerations as 
arise in the context of the present paper. 




16 


B. Application to the probe medium system 

The previous principle will be applied to the compound system of probe plus medium. We 
make however an additional simplifying assumption, that we can characterize the statistical force 
at probe position x* by finding the constant force B so that when applying B to the probe 
it actually relaxes to position x* as unique attractor and fixed point. Then, f{x*) = —B; in 
other words, B exactly cancels the statistical force at steady position x*. We now consider 
the modified dynamics with that additional constant force B on the probe and we require that 
p{x,r]) = 5{x — X*) Px*{'n) is the stationary distribution (always taken to first order in e). That 


requirement will be implemented by the free energy principle (or MINEP) (38) 


Let us take as test-distribution p{x,r]) = 5{x 
the McLennan distribution pz for the medium. 


which from (37) becomes 


— z)pz{r]) that would put the probe at z and take 
We now write for that choice Tneq{p) = J^neqiz) 


Tneqiz) = -B-z + {U{z, r,)Y - TS{pz) + I 

J'-f. 


dw® 




where the last line-integral gives the excess work when moving from z to x*. The principle (38) 
tells us that 


-B-z + {U{z,p)Y -TS{pz)+ [ dW 

>-B-x* + {U{x\p)Y* - TS{px*) = -B-x*+ Feq{x*) (39) 

where we inserted (correct to first order) the equilibrium free energy. We insert z = x* + dx* for 
small deviations around the attractor and find at the minimum 


dTeq(x*) - m^^{x*) = B-dx* 

which is again the sought result as B = —f{x*). Supposing there is a unique x* at which f{x*) = 0, 
that point is characterized by minimizing the nonequilibrium free energy Tlieq- 

For example, when two reservoirs are in mechanical contact, separated by a piston, the piston 
will move to equalize the two pressures but the pressure is not just the derivative of the equilibrium 
free energy; one will need to estimate the change in excess work under variations of the piston 
position. More specifically, consider a gas in a vessel divided into two compartments with volumes 
Ai -|- A 2 = A via a movable piston, under isothermal conditions. If we start “stirring” the gas in 
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compartment 1, the piston gets moving to continuously decrease the nonequilibrium free energy 

Jneq(Al, A 2 ) = -Al(Ai) + F2{k2) - diyf" (40) 

until it attains minimum. The latter of course corresponds to equalizing pressures Pi = P 2 with 
Pi obtaining a nonequilibrium correction, Pi = —dPi/dAi + dlT^^^/dAi. 

Note that here again we have considered the physical context of even degrees of freedom for the 
medium. As is known, the minimum entropy production principle does not apply with velocity 
degrees of freedom; see e.g. m- Yet, the mathematics and the formal arguments as presented 
above remain of course valid as such, although in that case of non-even degrees of freedom without 
a direct physical interpretation. 

V. MEASURING DYNAMICAL ACTIVITY 

Dynamical activity measures the time-symmetric current or the number of transitions in a 
given space-time window. It is the change in that activity when perturbing the system, or the 
relative activity when comparing different transition paths, that matters in response theory 
m- In fact, also for detailed balance dynamics, the dynamical activity appears important for 
understanding aspects of jamming and glass transitions [SUES]- However, dynamical activity is 
difficult to access directly. Here we look into a toy example demonstrating how nonequilibrium 
statistical forces could be used to (indirectly) measure the relative activity, at least in the case of 
a simple state-space geometry. 

Assume we have an equilibrium system of noninteracting particles the configuration space of 
which splits into two parts, A and B, connected through a two-channel bottleneck only; see Fig. 
— we call them the -|- and — channel. We want to find out which of the two channels is more “open” 
in terms of their relative dynamical activities. The idea is to connect this question to the prob¬ 
lem of how statistical forces respond to switching on a weak nonequilibrium force in the bottleneck. 

The bottleneck consists of a pair of (single-particle) transitions A 3 aA as ^ B with rates 
k^{aA,(TB) = 7± exp (f [C/((Ta) - U{aB)]) respectively k^{aB,crA) = 7± exp (f [[/(itb) - U{aA)])- 
The rest of the system is arbitrary up to that the transitions satisfy detailed balance with potential 
U and k°{r],ri') = 0 whenever rj, rj' do not belong either both to A or both to B. We are to 
determine the dynamical activities D± defined as the mean equilibrium frequency of transitions 
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FIG. 3: Frenometer: (a) Schematic representation of the two types of configurations connected through a 
two-channel transition path, (b) The nonequilibrium correction to the statistical force for the toy model (for 
a fixed x = tt/2.) as a function of the driving e through the bottleneck for two different values of 6 = 1, 2. 
and ^ = 0.1. We can read the relative dynamical activity in equilibrium from the slope. The inset shows the 
same correction g{x) as a function of x for a fixed e = 0.2 and different ^ = 0.1,0.5. Here 6=1. 


along the channels ±. From detailed balance, 

D+ ^ p’^^{aA)k°+{(rA,(^B) +p‘'%(yB)kX{(JB,crA) ^ 7+ 

D- p^^{aA)k?_{aA,crB) + p‘^^{(7B)k'^{crB,aA) 7- 

Such a relative dynamical activity and its further dependence on nonequilibrium parameters is an 
example of what we call more generally frenetic aspects, to contrast it with entropic features. In 
that way, the set-up in Fig. [^represents a frenometer as we now show. 

Now enters the interaction with a probe. Therefore, we let the energy U also depend on the 
position X of the probe. The equilibrium statistical force on the probe is derived from the free 
energy. The partition function is the sum over all states, Za,b = YlrjeA B and that force 

equals 


/eq = TVx log(Z^ -b Zb) 

= PaIa + PbIb 


(42) 


where fA,B = TS/x log Za,b is the mean force from A and B, respectively, and pa,b = Za,b/{Za + 
Zb) Is the proportion of time the equilibrium system spends in each compartment. 

In order to measure the relative activity 11+ / D -, we drive the system out of equilibrium by applying 
a local nonpotential force which modifies the transition rates in the bottleneck to 


k±iaA,aB) = ^^e2^Uix,aA)-U{x,as)±e] 
k±{aB,aA) = ^^e2^U{x,as)-Uix,aA)Te] 


(43) 
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A possible e—dependence of the kinetic factors 7 ± is allowed but irrelevant for linear order calcu¬ 
lations; see below in (47) and the dependence on the parameter b in Fig. We show next that the 
nonequilibrium correction to the statistical force gives information about . 

An immediate effect of turning on the drive is a redistribution of the particles, described to 
linear order in e by the McLennan ensemble (|^. For the V{x,rj) there we need the work performed 
by the applied force along those parts of the relaxation trajectories that pass the bottleneck. All 
trajectories, say originating from part A, have to pass through the “port” aA in order to access the 
bottleneck, and since no other transitions contribute to dissipated work but the two special channels 
±, V{x,r]) = Va,b is constant inside both A and B. A calculation to linear order (Appendix 
yields 

L»4- - D 


VA-VB = e^, C = 


D+ + D_ 


(44) 


supplied with the normalization condition ZaVa + ZbVb = 0. The difference Va — Vb can be 
detected as a nonequilibrium correction to the statistical force acting on the external slow particle. 


By formula (13) and since hx(j]) = —/3V(x,7]) + O(e^), that correction equals 

g(x) = = - ^ V(x, T/)V^pl^(Tf) - V(x, r?)V.p^^(ry) 

r/eA r/eB 


= -VaV, 

= V, 

2 




Za + Zb 
Za - Zb 


— Vb^x 
+ 0{e^) 


Zb 


ZA + Zb 


(45) 


Za + Zb, 

In terms of the (equilibrium) occupations and statistical forces associated with A respectively B, 
the nonequilibrium correction to the statistical force takes the form 

9 = e^/3(/B - /a) PaPb + O(e^) (46) 


Hence, the channel-asymmetry factor characterizing the relative importance (in terms of 
dynamical activity) of the two channels, can be evaluated from the first order correction of the 
statistical force. It determines the slope in Fig. |^b) in the close-to-equilibrium dependence of 
the statistical force on the nonequilibrium amplitude e given that we know the equilibrium values 
/a,s and PA,B- 


For illustration we take a simple toy system where both A and B are two three-state rotators 
with states rjA,B = —1,0, 1 with bottleneck states a a = 1a and ub = ^b connected by two channels. 
The probe is connected to the rotators via interaction energy 

U (x, Pa) = ^a,A\TI sinx -|- 2p^ cosx] -|- 5a,B[p cosx -|- 2p^ sinx] 
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Note that the specific form of the interaction potential is not of any particular relevance; the above 
choice just avoids special symmetries. We assume that the drive affects the reactivity of the + 
channel 


7+= 7+(l+ &|e|) (47) 

for some constant b. The nonequilibrium correction to the force g as a function of the drive e for 
a fixed probe position x is shown in Fig. |^b); the slope of the curves close to e = 0 is determined 
by the channel asymmetry factor ^ confirming ( |46[ ). But there is more: the second order is able to 
pick up the e—dependence (parameter b) in the channel reactivities, invisible to linear order. That 
is in line with the analysis of higher order effects in the response formalism in [33] . We can thus 
measure the changes in time-symmetric aspects of the medium due to its nonequilibrium condition, 
from observing the probe’s motion. 


VI. CONCLUSION 

We have discussed in detail how the statistical force of a medium becomes modified when the 
medium is weakly driven out of equilibrium. Independent of the nature of the driving, the system¬ 
atic nonequilibrium force is intimately related to the steady state thermodynamics of the medium 
as governed by the (slow) motion of an attached probe. In this way, a simple measurement on the 
probe can reveal the excess work of driving forces in the medium, which is hard to be measured 
directly as it requires to distinguish a rather tiny effect against an omnipresent dissipative back¬ 
ground. It was demonstrated how this result emerges both thermodynamically (via a generalized 
Clausius relation) and statistical-mechanically (via the McLennan nonequilibrium ensemble). We 
have also formulated a variational principle for the point attractors of the macroscopic probe in 
terms of a nonequilibrium generalization of the free energy which realizes the minimum entropy 
production principle. Finally, we have shown how to set up a “frenometer,” using the statistical 
force to measure relative and excess dynamical activities. That can be important as it adds op¬ 
erational meaning to that time-symmetric variant of current which is known to be important for 
nonequilibrium response theory. 

From a more general perspective, the analysis of statistical forces poses a complementary (me¬ 
chanical) problem to the (calorimetric) problem of heat exchange between the medium and its 
thermal environment, which can be quantified via nonequilibrium heat capacities. Establishing 
quantitative relations between both sectors remains a relevant and nontrivial problem of steady 
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state thermodynamics. 


Appendix A: Excess work 


We start with a brief review of the McLennan ensemble for the purpose of this paper; see 
for more details. That ensemble summarizes the static fluctuations in the linear regime around a 
detailed balance dynamics. One can get the linear response relations, including Kubo and Green- 
Kubo formulae directly from it. Interestingly however, the McLennan ensemble can be obtained 
from physically specified quantities, and therefore can be formulated even without detailing the 
dynamics. The most elegant and physically direct way to obtain that ensemble is in [M] and starts 
from a perturbation expansion of an exact fluctuation symmetry for the irreversible entropy fluxes. 
The main player there is the excess work whose meaning is already visible from Fig. [^b). The 
excess work is associated to a force G which is doing work on the medium and that is dissipated 
in the heat bath. That force G can be the total force or only its non-conservative part or even 
something else. 


To be specific we imagine an overdamped diffusion process yt much as in (19), 

72/* = -^U{yt) + F“ + V 27^ 6 

where we split up the total force into a conservative part with potential U and stands for the 
driving force. (There is no need to be precise about this splitting of the total force for defining the 
McLennan ensemble.) The expected current is y — when the distribution over y is y 

where the total force is F = —VU{yt) + 

The instantaneous mean power associated to G is 

W^iy) = I G{y)-j^{y)dy 
We thus have W^{y) = f dyw^(y) y{y) and 

w^iy) = -G{y) • F{y) + -V • G{y) 

7 7 

is the dissipated power when in state y. G = F the total force, the last identity is recognized in 
(31) (with total force also still depending on the probe position x). Note that is linear in G so 


that the power (and excess) is additive in the force G. To go to the excess we need to subtract the 
stationary dissipative power and integrate over time to get the excess work V^: 


y^{y) = dt [{w^iyt)\yo = y)- (*«'^)] 
Jo 


(Al) 
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For example, by taking G = —VC/, we get 


w^iy) = - ^ VC/( 2 /) • F{y) - ^AyU{y) =-LU 

7 7 


for backward generator L, 


1 T 

L= -F-V + -A 

7 7 


(A2) 


Formally in (A1), = —L (with {V^) = 0) is the result of acting with the pseudo-inverse 

L~^, and therefore the excess work by the conservative force equals U{y) — (U) when relaxing from 

yo = y- 

The V in the McLennan ensemble starting in (§ and throughout the paper is the excess 


work associated to the driving force G = F°', or V = . Formula (|32|) gives the excess work 


as defined in the McLennan-ensemble for the total force Fx{y) = sAay — 'VyU{x,y), including 
the conservative part. The reason to include there that conservative part is the simplicity of the 


Ansatz (33) which is further discussed in the next Appendix. 


A second computation of excess work (for jump processes) leads to the result in formula (44). 
We already mentioned there that V{rj) = V{aA) when y £ A, and similarly V{r]) = V{aB) when 
y £ B. That is because the only transitions with irreversible dissipation are those through the 
two channels at the bottleneck. When computing the excess work V{y) (now only due to the 
nonconservative forces) in general we must look at the expected excess dissipation, and thus here 

V{y) = sNrj{A 4 5) - sNy{A ^ B) + eNy{B ^ A) - eNy{B 4 A) 

where the are the expected total number of transitions when starting the equilibrium process in 
y. Those expected number of transitions are determined by the transition rates and the expected 
number of visits: 

r+oo 


r-\-oo 

Va-Vb = e(7+ - 7-) / {^AB ^t{A, A) - pt{B, A)] kBA \pt{B, B) - pt{A, 5)]} 

Jo 


dt 


where the pt are transition probabilities and the kAB = k^]^ = exp[U{aA) - U{aB)]/2. The rest 
of the computation uses detailed balance to reduce the case to that of a two state model with two 
channels. The approach to equilibrium is exponentially fast with rate r = ( 7 + -|- 7 _) [kAB + 


Integrating over time exp [—rt\ gives the required formula (44). 
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Appendix B: Computations for the linear model 


In this Section we give the explicit computations leading to the statistical force and excess work 
for the linear model studied in Section im 

Under stationarity the position of the cloud particle fluctuates around the average Cx for a fixed 
probe postition x. For this linear system, the stationary density Px{y) then must be a Gaussian of 


the form Eq. (21), 


Px{y) =AAexp|^- — (y-Cj,) ■T{y-Cx) 
where F is a positive symmetric matrix which is to be determined from the Smoluchowski equa¬ 


tion (20) with Fx{y) = —D{y — Cx)- Then, 


1 

^ypx{y) = - Cx) px{y) 

\ Px{y) = ^ r(y - Cx) ■ T{y - Cx) px{y) - ^ Tr[F] px{y) 


and Vy ■ Fx{y) = —Tr[Il]. Substituting the above in Eq. (20) we get that the symmetric matrix F 
must satisfy the following relations. 


{y - Cx) ■ D^T{y - Cx) = {y - Cx) ■T‘^D{y - Cx) 

and Tr[F] = Tr[T)] 


(Bl) 


The first equality demands that the symmetric part of is equal to F^ which is expressed by 
Eq. (22). Multiplying Eq. (22) from the right with F, one gets D + T~^D^T = 2F. Taking the trace 


on both sides leads to the second equation above. 

Next we detail the computational steps leading to the alternative form of the energy U{x,y) 


(27). From (16) we have 


u{x, y) = ^y- Dsy - Xy ■ Bx + ]^x ■ {XB + K)x 

Replacing XBx by Dcx (from the definition of Cx) in the second term and performing a few steps 
of algebra we have, 

U{x,y) = - Cx) ■ Ds{y - Cx) + Cx ■ Da{y - Cx) - ^Cx ■ DgCx + • {XB + K)x (B2) 

where we have used Cx • DaCx = 0 for the antisymmetric matrix Da- Now, again using the definition 
of Cx 

Cx • D,Cx = h^x • R((T)-I)t + D-^)Bx 
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Substituting this in (B2) leads to (27) where 


Ms = K + \B - + D-^]B 

Finally, the excess work when the medium particle starts from a fixed position y for a given 
fixed probe position x is related to the power of the driving force through 


L(C/(x, •) + V{x,-)){y) = -Wxiy) + {w^) 


(B3) 


where L is the backward generator for the cloud particle as in (A2). From Eq. (31) we have 


1 T 

Wx{y) = -Fx{y)-F^{y) +-Vy-Fs,{y) 

7 7 

= -D{y - Cx) • D{y - c^) - —Tt[D] 
7 7 

and {w^{y)) = -Tr[D^DT-^] - -Tr[D] 

7 7 


(B4) 


The excess work performed by the total force on the medium particle must be of the form (33) 


for some symmetric matrix 14 because there is no force, Fx{y) = 0 when y = Cx and the work must 


be symmetric in y — Cx- We will find 14 from requiring (B3). The left-hand side of (B3) can be 


calculated using (33) 


W{x,y) = n{y - Cx), and AyV{x, y) = Tv[n] 


(B5) 


Hence, 


LV{x,y) 


Demanding (B3), we must have 


1 

7 


D{y - Cx) ■ 14(y 


Cx) + —Tr[14] 
7 


{y - Cx) ■ D'fl4(y - Cx) 
and Tr[14] 


{y - Cx) ■ D^^Diy - Cx) 


Similar to (Bl) above, the first equation states that the symmetric part of D^14 is equal to D 


which results in Eq. (34). The second equality above follows from there using Eq. (22) because 
Z4^14F“^ + 14Z4F“^ = 2D^Z4F“^ of which we can take the trace with left-hand side giving 2Tr[14]. 
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